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ABSTRACT 

The distance dist(f,3P ) of functions f with certain singularities 

n § K 

from IP := functions consisting of no more than K polynomial pieces of 
n f K 

order n is shown to be 0(K n ) , i.e., of the same order as dist(f,P ) 

n , K 

for f e C^ n \ It is shown that this optimal convergence rate is realized by 
approximations constructed with the aid of a simple adaptive algorithm. 

The paper offers a very simple mechanism for the analysis of the error 
achieved by such adaptive approximation schemes. 

AMS (MOS) Subject Classifications: 41A63, 41A15, 41A25, 41A40, 41A55 

Key Words: adaptive, piecewise polynomial, approximation, quadrature, 
multivariate, degree of approximation 

Work Unit Number 6 (Spline Functions and Approximation Theory) 

EXPLANATION 

In adaptive quadrature and other processes of piecewise polynomial approxima- 
tion to some function f on some domain D, one subdivides the domain D 
into cells C , ...,C and constructs on each cell a polynomial approximant to 

1 lx 

f. Computational efficiency both in the construction and in the use of such 
approximations demands that a given error requirement be met with as small a 
number K of polynomial pieces as possible. How such optimal subdivisions 
might be chosen, is at present only fully understood in case D is an interval, 
i.e., when approximating to functions of one variable. The paper proposes a 
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very simple algorithm for developing an appropriate subdivision when f is 
a function of many variables. The point of the paper is to show that the 
error achieved by the piecewise polynomial approximation so constructed goes 
to zero like K n as the number K of pieces becomes large, even when the 
function f to be approximated behaves badly in places. Since one cannot 
hope to do better than 0(K n ) even when approximating a very smooth 
(analytic) function, this shows that the algorithm realizes the potential of 
piecewise polynomial functions to approximate well even to badly behaved 


functions . 


AN ADAPTIVE ALGORITHM FOR MULTIVARIATE APPROXIMATION GIVING 


OPTIMAL CONVERGENCE RATES 
Carl do Boor and John R. Rice 


I • Introduction . We consider approximation from the class 

IP 


n,K 


, N 


of functions on (some domain in) IR which consist of no more than K polynomial pieces 

eacli of order n, i.e., of total degree less than n. Approximation from IP for 

n , K 

N > 1 Wets studied as early as 1967 by Birman and Solomiak [2]. Improvements of their 

results were obtained by Budnyi [3], and much of the work is presented in his survey 

article (4). Birman and Solomiak make use of a kind of adaptive partition algorithm in 

some of thc.ii work, but their results do not contain ours nor ours tiieirs. Their results 

go beyond the statement that dist(f,I ) - 0(K ") for smooth functions. But, their 

n,K 

description of certain function classes for which such an optimal rate of approximation 
is achievable it in terms of certain moduli of smoothness. This description is difficult 
to apply to a specific function not in C^ n *. By contrast, our analysis includes 
explicitly functions oi the form 

f (x) = g(x) dist (x ,S ) U 

where g e C ^ " ' and S is a smooth manifold. We show that the optimal convergence rate 
N 

on I) C ic C an be achieved if a > mn/N - (N-m)/p, where m := dim(S) and I, - 
approximation is used. We also show by an example that this restriction on a is in 
genera] necessary for optimal convergence rates. These examples help to establish the 
boundary of the class of functions which saturate piecewise polynomial approximation. Our 
analysis is not restricted to piecewise polynomial approximation and includes, for example, 
approximation by blending function methods. 

We now describe the subject matter of our paper in some detail. 


Sponsored by the United States Army under Contract No. DAAG29-75-C-0024 . 


We are interested in gauging the efficiency of an adaptive algorithm for the 
approximation of functions, or of functionals on functions, on some domain D in K N . 

The algorithm produces a subdivision of D into K nonoverlapping cells C , ...,C 
and, on each such cell C^, an appropriate approximation. 

The ingredients for the algorithm are: 

al. a collection T of allowable cells. 

a2. a (nonnegative) function E:(T— *■ ]R, with E(C) giving the error (bound) for 
the approximation on the cell C. 

a3. an initial subdivision of the domain D into allowable cells. 

a4. a division algoritlun for subdividing any allowable cell C into two or more 
allowable cells. C is called the parent for these latter cells. 

The adaptive algorith m consists in producing, for each current subdivision, a new 
subdivision by dividing some cell in the current subdivision a la a4, until E(C) <_ e 
for all cells in the current subdivision, with e some prescribed positive number. 

Existing adaptive algorithms for quadrature or for piecewise polynomial approximation 
(in one variable) are considerably more sophisticated than this simple algorithm. Yet 
our simple algorithm allows us to analyze quite satisfactorily the efficienc y of the 
approximations produced by these more complex algorithms, i.e., the relationship between 
the prescribed tolerance e and the number K = K(e) of cells in the final subdivision. 

Here, we visualize the work of constructing the appropriate approximation on ar. 
allowable cell to be the same for all cells so that the work for constructing t..e final 
approximation is proportronal to the number K of cells in the final subdivision. This 
is still true even if we count all the intermediate approximations constructed as well, 
since the total number of cells considered cannot be bigger than 2K. On the other 
hand, e, or at times Ke , or some other function of e, measures the accuracy achieved 
by the final approximation. 

For the analysis of the relationship between K and c, we make the following 
assumptions regarding (T and E. 
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cl. C consists of bounded, closed, convex sets. 

c2. Cells are not too different from balls: Associated with each cell C e C 

are two closed balls, b c and B c , for which b c £ C £ B c > and 

n : = inf diam(b )/diam(B ) > 0 . 

Cfl C 

c3. Invariance under scaling: If C * 1C and c is the center of its inscribed 

ball b c , then, for all positive p, 

C := c + P (C - c) e E . 

P 

dl. Parent and children have comparable size: For some positive 8 and all C e C 
each child C' of C produced by the division algoritlim a4 satisfies 

|c* |/|c| > 6 . 

Here,, and below, |b| denotes the N-dimensional volume of B. 

el. Monotonicity: C £ C' implies E(C) <_E(C'). 

The basic tool in our analysis is the number 

(5) | E | := / dx/e(x,c) 

C D 


with 


We will show that 


0 (x,e) := inf { |c| : x f C f t, E(C) > e} . 


(6) K(e) < M e /B 

and, in this way, obtain quite explicit bounds on K for specific choices of E. The 
following lemma gives a hint as to why (6) might hold. 

K 

Lemma 1 . If (C.) is a subdivision for D with E(C.) > e for all i, then 



-Proof". We have 


K K K 

K= l |C. |/|C | = l I dx/|c | I IS dx/0 (x ,e) = |e| 

i=l i=l C. 1 i=l C. ' 

1 1 


8(x,e) < |cj for all x e /// 
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Of course, this argument fails to establish that 1/9 ( . . c ) is even integrable. 

But, as we said, it gives a hint as to why (6) might be true. 

In the next section, we derive various basic properties of the function 0 and the 
number | E | ^ and prove (6). 
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2. The function 6 . We begin our discussion of the function 6 by establishing 
some properties of the allowable cells. 

Lemma 2. For all C e C and all y, the allowable cell C := c + p(C - c) 

p 

contains y for all p > 1 ♦ dist (y,C) /radius (b^,) . Here , c is the center of the 
associated inscribed ball b^. 

Proof. Any such cell is allowable by c3, so that we only have to prove that y e C 

for the specified values of p. This is obvious for dist(y.C) = 0. Let dist(y.c) > 0 

and let b' be the ball around y of radius dist(y.C), and let d' be a point common 

to C and b' . In the plane determined by d', y and c, let £ be the straight line 

which intersects the segment |c,y), at the point d, say, and is tangent to b c , at 

the point t, say. Then dec by convexity, hence y is contained in the ball 

c + — el /jp - c ) 

C |d - c| lb C C) * 

But then, r:=dist(y,£) <^dist(y,C), and, with t' the point of £ closest to y, the 

two triangles (c,d,t) and (y,d,t‘) are similar. Therefore 

I y - d [ _ |y - t * |_ _ r < dist (v, C) 

|d - c| |c - 1 1 radius (b^,) — radius (b ) 

and the lemma now follows since |y - c|/|d - c| = 1 + |y - d|/|d - c|. /// 

Corollary . If 0(x,e) < “> for some x, then 0 is bounded on bounded sets. 

Proof . By assumption, there exists C e C with x f C and E(C) > t. If now 

y f C, then ®(y,e) < |c|, while, if y f C, then, by the lemma, y c C^ = c + p(C - c) 

for P := 1 + dist (y,C) /radius (b_) . But then, C H C (by convexity of C) , hence, 

C p — 

by el, E(C p ) i E(C) > E. This shows that, for every y. 


(7) 


0 (y, e) 1 |c | = p N |c| . /// 


A little more work proves that 0 is locally Lipschitz continuous. 
The orem 7 . 1 . I_f. 0 ( . , e ) is finite at some point, then 
(8) 1 0 (x, c ) - 6(y,c)| < L(x,y)|x - y|, aid x, y , 

with L bounded on bounded sets. 
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Proof . Let x e C e C with E(C) > e and let r := radius(b c ). By (7), 

0 (y.E) - |c| 1 (P N - 1) | C | 

with 

P = 1 + dist (y, C)/r <_ 1 4 |y - x|/r , 

hence 

(P N - 1) |c| < (P - 1) jcj l p n 

n^l 

< |y - x|(|c|/r N ) l (r + |y - x|) n r N 1 n . 
n=l 

By c2, |b c | <_ | C | < | B c | £ 1 J / p N while | t> c | = r^const^. Therefore 
|c|/r N < const /R N and r < (|c|/const showing that 

o (y, t) - |c| < (P N - 1 ) I C I <.F N (|c|,|y - X I ) I y - x| 
for some function F^ which depends only on N and is monotone increasing in its two 
arguments. By taking the infimum over all such C, we get 

0 (y , e) - 0 (x,e) <_ F (0 (x, e) , | y - x|)|y - x| , 
which proves (8) with L(x,y) := F (max{0 (x, c) , 0 (y , e) } , | y - x|). But such L is 

bounded on bounded sots by the corollary to Lemma 2 and the monotonicity of F . /// 

N 

N 

C orollary . If G C tr i s bounded and m^ := inf x£( _0(x,E) > 0, then 1/0 (,,e) 
i s Lipschitz con t i nuous on G . 

It is obvious that 0(x, - ) is monotone (even if E were not). Further, one 

would expect lim £ + ^0 (x, e) = 0 for each fixed x, but this need not happen. Consider, 

e.g., the case when N = 1 , (T consists of all closed intervals, and E(C) = dist (f,r, ) 

<», C 1 

with f the step function having just two jumps, both of positive size 2, at -1 and 
1, say. Then 

E(C) = number of jumps of f contained in C . 

Therefore, 0(x,t) is infinite for e ^ 2. Further, for 1 < e < 2, 


r 



llx.lll 

“1*1 + 1 

if 

x < -1 , 

0(x,e) “ < 

1 (-1,11 

1 - 2 

if 

-1 < x < 1 


I [ — 1 , x ] 
V 

| = x + 1 

if 

1 < x . 
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Finally, for 0 < e < 1, 


6(x,e) = dist(x,{-l,l}) . 

Note that the failure of 0 (x,e) to go to zero with e implies, because of (6), 

unusually good approximation rates possible. This will be taken up again in Section 5. 

The example also illustrates the possibility that, even for positive e, 0 (•,£.) 

may vanish at some points. In such a case, though, our algorithm will not terminate 

since then, by the monotonicity of the error E, E(C) >_ e for all C containing a 

point x with 0(x,e) = 0. Since 0(y,e) cannot grow faster than const|y - x| near 

such a point, by Theorem 2.1, it follows that / dy/0(y,c) is infinite for any G 

G 

containing x. Thus, (6) holds trivially in case 0(x,e) = 0 for some x e D, both 
sides then being infinite for all small c. 

We are now ready to prove (6) . 

Theorem 2.2 . Let (C^)^ be a subdivision o f D produced by the adaptive algor ithm 
. o . o 

from an initial subdivision (C\) with E((h) > c, all i. Then, with 6 the constan t 
in assumption dl , 

(6) K £ | K | c /6 . 

Proof . By assumption, 9(-,e) is finite everywhere and, since the algorithm 
stopped, l/0(-,e) must be finite everywhere in D. Hence, by Theorem 2,1, l/0(*,c) 

is continuous on D (and positive), thus integrable, and 

(9) for all C e I, / dx/0(x,e) = |c|/6(x ,e) for some x e C . 

C C C 

Now, for each i, let J. be the parent of C. (in the sense of a4) . Then E (J . ) > c, 

l i i 

therefore 0(y,e) £ |j.J £ |c.J/e, using dl, for all y f J . Hence 

K K K 

K= 1 |c |/|c | £ e _1 l |c |/0(x ,e) = e" 1 l J dx/0(x, t ) = |e| /B , 

i=l i=l i i=l C. c 

1 

which finishes the proof. /// 

We will show in many specific circumstances that, as c -» 0, both K = K(e) and 
)e) £ go to infinity at the same rate, so there is then no doubt as to the sharpness 
of (6). Still, it is nice to know in general whether the two quantities are comparable. 
For this reason, we now prove a converse inequality. 


-V- 



1 


Theorem 2^3. Suppose 

1/G(.,e) is Riemann inteyrable uni 

formly in E, i.e.. 

there exists u with w(0 

-t 

) = 0 so that for 

any subdivision 

(C.) of the bounded 

domain D and choice of paints x. * C. , 



| / dx/6 (x, 
D 

i l 

£> - Z. |c. I/O (x . , C ) 1 
1 1 1 

< m (max^ | C^| ) | e| 

, all c . 
e 

Then, for any subdivision 

K 

(C.) of D with 

E(C ) £ e, al_l 

i , 

(10) 

l 1 — 

(l - w( | d|/k) ) |e| c 

- conSt N,e,n K • 



Hence, if lim^^K(e) = °°, then l E l £ an< ^ K (c) a pproach infinity at the- same rate . 
For the proof, we need the following lemma. 

Lemma 3 . I f C € (T and E(C) <_ e, then, at the center of the inscribed ball 

b c for C, 

Ui) e(x c ,c) > (n 2 / 2 ) N |c| . 

Proof ■ If x c e C' e C with circumscribed bull B^., and | B^. , | <_ then 

c* c B c , c b c> and so E(C') £ E ( b c > 1 t’(C) < c, by el. Hence, x c c C' e I and 
E(C') > £ implies that J t> c | /2 N < |b'|, while, by c2, 

|c| £ l n cl — l b cl /T,N - |c|/n N for a H C e C . 

Therefore, |cj (n/2) N ^ |b c |/2 N < | B c ’ | < |c‘ |/n N , and (11 ) now follows since C' was 
arbitrary. /// 

Proof of Theorem 2.3 . Let (Ch)^ be any subdivision for D with E(C^) <_ l, all 

i, and let be the center of the ball b c inscribed in the cell C., all i. 

i 

Then, by Lemma 3 and the assumption on uniform Riemann integrabil ity, we have 
K K 

K= l |c |/|cj > ( 2 /M 2 ) N l |c.|/0(x.,£) 

i=l i=l 1 1 

= ( 2/n 2 ) N ^| e | E + ( £ |c i l/e(x.,f) - |e| c | 

> (2/p 2 ) N II - m (max . C. )] Ie| . 

~ 1 1 1 1 c 

There is, of course, no guarantee that max. |c\ | -*■ 0 as c -* 0. Still, we may 
refine our subdivision sufficiently while keeping the number of its cells within 0(K) 
as follows. Starting with the subdivision (C^)^ under discussion, we carry on with 
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L 


is leached with 


K 1 

the adaptive algorithm until a new (finer) subdivision (C') 

i 1 

maX i I C i I — Then, the parent of each new cell must have had volume greater than 

|d|/K, hence there must have been less thjn K such parents, and each such parent 
could not have had more than 1 /p children, by dl . Consequently, K‘ <_ (1 + B _1 )K (in 
particular, the algorithm must have stopped), and from our earlier argument, now applied 
to the refined partition (CM, 

(1 + 6'Sk > K 1 >_ (2/6 2 ) N [l - tu( |d|/K) ] | E | e . /// 

We conclude this section with a short discussion of our error measure 

|e| e = / dx/e(x # c) . 

D 


E increases with c and, usually, lim Ie = In particular instances, we 
€ f->0 1 r 

are able to state quite precisely how [e|^ goes to infinity with c . 


In general. 


is monotone, i.e., 


( 12 ) 


Also, |El e - l at 'l ac for a > 0. Finally, 


(13) 


l» 4 F I 2c 1 |B| C + l F l c 


For the proof of (13) , note that for any C t C with (E + F) (C) > 2e, we must have 

maxfE (C) ,F (X) } > e, hence 0 r _(x,2e) > min{0„ (x ,c) , Q_(x,e)}, and so 

t+r — L 1 


|E + F| 2e majc {e^F' e K (x,; )J‘ lx 1 I E 


+ F 

c 1 1 e 
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3. All example: Best approximation in 1L Ia,bl from P . In thin sprtinn 

= — P n,K 

we bound |e| f for a specific choice of E in order to illustrate the use of 
Theorems 2.2 and 2.3. 

We are given a function f on some interval [a,b], and f is in C n on 
(a,b]\{s). But we know that 

(15) |f (x) | <_ const f |x - s| Q n 

for some a with ap > -1. We intend to approximate f from P , i.e., by piecewise 

polynomial functions consisting of at most K polynomial pieces, each piece of order n, 


i.e., of degree less than n. 


We take the 1L -norm 
P 



as our measure of function size. Our assumptions on f then imply that 
Rice (8) has shown some time ago that, for such an f. 


f e P [a,b] . 
P 


dist (f,P > = 0(K _n ) . 

P n , K 

We are about to reprove this result. In fact, we will prove that the approximation to 

such a function f constructed by the adaptive algorithm approaches f at the rate 0(K n ) . 

As collection I of allowable cells we choose all finite closed intervals on K. 

Thus, cl, c2, c3 are satisfied, and n = 1 in c2. For the division algorithm a4, we 

take interval halving, so dl is satisfied with 6 = 1/2. 

Ideally, we w’ould take for the error measure on the interval C the distance of 

f| from P , 

|C n 

E,(C) := dist _(f,PJ . 
r p j C n 

But it is simpler, and corresponds better to actual practice, to work with some bound 

K(C) for E,(C). Such a bound we now derive. 

If f £ C n (C) for some interval C C [a,b] , then dist „(f,F ) 

p,C n 

< const ll f * n *|l | C | n+1// P_ Thus, with our assumption (15), we have E (C) < const F (C) , 
n P,c f — f ( n 

wi th 

(lb) F(C) := dist(s,C) a_n |c| n ' ,3/p , all CC[ a ,b] 
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for such C. Note that F(C) = ™ in case sec if, as we assume, 

a < n . 

Hence, for such C, and for C "near" s, we need an alternative bound. If s is 
not in the interior of C, e.g., C = [u,v] with v <_ s, then we have 

f(x) = [ f (j) (u)(x - u)Vj! + / (x - t) n_1 f <n) (t)dt/(n - 1)! 
j<n u 

and so 

v x 1 /p 

dist ; c <f , const^ I J \J |x-t| ni f* n ^(t)dt| p dxj 

P ' n ’ u u 

But, by (15), 

1/ (x - t) " 1 f (t)dt | £ const / |x-t| nl |t-s| an dt. 

u n ' u 

X 

i const n ,f / I s - t-l^dt 

u 

< cons t Is - x I . 

— n, f 


Therefore, 



d ist 

r 

. (f , I ) < con; t 

, < n — 

:j/ |s - x| 'dx] < const | 

(s - x) a ° /p ^ . 

u 

This 

!.h wi, t hat , 

• . h C, 

di‘ 

%.c( f 'V lconst fn G(C), 

with 

(IV) 


G (C) : = 

(di; 

d(;.,C) -t |c|) a41/p , all C 

£ |a,b) . 


Finally, if 

the singul.it 

ity 

s lies in the interior of 

C, then the error might 


be at bud as const j.|c| ^ without additional hypotheses on f. Hence, if a > 0, 

then we assume that dist _(f,r ) < const _G (C) also for C with s c int(C). 

P * v- n — n, 1 

To summarize, we have 

U8) * £ < const _E := const _ min{F,G) , 

t ~ n, f n, f 

with F and G given by (16), (17). Both F and G are monotone, and continuous 
where they are finite, and F(C) = «° implies G(C) < »>. Hence E is monotone and 
continuous. Extending E to all of C by 
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E(C) := E(C n I a , b ] ) 


clearly changes nothing in this. 

Prop os ition 3.1. For the function E def i ned in (1 8) , 

l_i -l/(nH/p) 

E < const e * 

1 e — 

Proof . For each x r fa,b] , let be an interval with x £ and l c x ! = 8(x,e), 

hence EtC^) = c. Such surely exists for all sufficiently small e by the continuity 

of E. Then C C (a,b) . 

x — 


If now dist (s.C^) |c x |, then 


“~n. |n + l/P _ 1 ^. ; a, i/r 


F(C ) = dist (s ,C ) ~ n |c | /P > |C | 


wliile, for any C, 


G(C) > C 


,itd 1/p 


Therefore, dist(s,C ) < Ic^l implies that e |c - x | a ' hence 


Is - x| < distts.C ) + |C | < 2|C | < 2c 


1/ (a+l/p) 


. This shows that 


A := {x e [a,b] ! dist(s,C ) < | | 1 
has | A | <. . Since 

e < G(C ) <_ (2 1 C |)° H1/r for x r A , 


it follows that 


/ dx/0 (x, ( ) < |A!2c' ]/(a ' 1/p) <_ 8 . 


On the other hand, since t < F(C ) = dist(s 


s,C )“' n |c | n4VP , 


]/6(x,e) = 1/ 1 | < (di st (s .C^) 01 n /e) ^ 

and so, as |s - x| < distis.C^) + | | < 2dist(s,C x > for x f A, 

/ dx/Q (x , t ) <_ c -1/ (n+l/p) j h ()s _ x | /2) <«-">/<"< 1/P) dx 


, -1/ (m l/p) 

< t const 


a , b , a , p 


|e| = / dx/0(x,c) = (/ + /) dx/0(x,c) ^ 0 + const C 

C a A \A 


-l/(nU/p> 


which finishes the proof. /// 


J 


It follows with Theorem 2.2 that, for such a function f, the adaptive algorithm 


working cither with E, or with the bound const ,E for it, produces an approximation 
t n, f 


g f r to f for which 

n, E 


lc „ II P .. ,,,P _ t p-1/ (n+l/p) . pn/ (n+l/p) 

|f - g|| <_ Ke <_ const e = const e 


while, again by the proposition, e 
that then 


1/ (n+l/p) 


£ const// (dx/6(x,e) ) const/K. This shows 


I, || . n/ (n+l/p) -n 

|f - slip £ const c const K 


the promised bound. 


Note that the argument also covers functions having finitely many singularities of 


algebraic type no worse than a. Precisely, if f = ) f ., with f. f C ( (a ,b]N{s . } ) 

j ] 3 3 


and | f ^ n ^ | <. a^|x - s | ° n , all j, then, from the argument for (13), 


E | < } | a E . | 

f 're - 3 3 c 


with E , min{F./G.} and V. and G. defined by (10) and (17) with s replaced by 
D 3 3 3 3 


s . . Thus 
3 


II . f || , , -1/ (n+l/p r , .1/ n+l/p) 

f t ~ j_j 3 t/(ra ) 3 


Thetefore, the adaptive algorithm produces appi oxir.it i.-n: of optimal order fot sue), 
functions, too. 

We have ran icd out this last argument in such detail in ord»*r to show that it will 
not, by itself, support the analysis of an f with infinitely many singularities. For 
this, a more refined version of (13) would be needed. A1 • , oui argument comer, close 


to, but doer not recapture, the result by Burchard l r >-« J and others that 


dist r (f ' l n,K ) - con£;t K " n l|f ^ 1/ (n+l/p) 


The typical error bound is 


dist <f , 1 ' ) F (C) : F (C) C 
p,C n — 1 


n+l/p 


with F (C) - const |f (n) (c)|. Thus, c « F « ' ) | c x l ' ,V and so 


n+l/p 


1/0 (x , t ) = l/|cj » (F(C x )/t) 


l/(n+l/p) 
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Therefore 


with o := 1/ (n+l/p) . 
technical difficulties. 


|B| e - / dx/0 (x,e) = e ~l/ (n+l/p) y F(c ^l/(ntl/p) dx 
~ e - 1/(n41/ P> ||f <n) ||%onst . 

It is this last approximate equality which causes additional 
Once it is settled, the argument finishes as above. 
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N 

4_. Ti le ad a pti v e approxi n. it ion of a func tion o n IR with singu l arities on a 

smooth manifold . In this section, we investigate the approximation of a function f on 
some bounded domain D in 1R^ when f is in (D'-S) for some smooth manifold S 

of dimension m. We do not specify the collection (E of allowable cells beyond the 
requirements made in Section 1. Then we have 

(19) dist „(f,F ) < const f (n) (C) |c| 1/p (diam C) n for C n s = 0 

p,C n — n 1 

with 


as is well known (sec, 
N 

of polynomials on H 
i.e. , if f (D) < 
approximation g to 


f* n '(C) := sup max | (D V f) (x) | , 
xfC | Y | =n 


: .g . , Morrey [7; 

p. 85]). 

Here, 

p 

n 

stands for the 

col lection 

of total degree 

less than 

n. 

I f now 

f were smooth 

enough. 

then, for any partition 

<v? 

of D, 

we would get 

an 

with 







Ilf 


g|| = J* dist 

P . p,C 


< (const f 


< (const f 
— n 


<f,p ) p 
n 

(n) (D) ) P l | C . | (diam C. )" P 
r 1 i 1 i 

l 

^ (P) ) P (max^ (diam C^) n ) P |p| 


hence 

|| f - g||^ <_ const^ f ^ max^ (diam CP) n . 

This expression is of 0(K ^ ) if the CP are chosen to be mere or less uniform. We 
intend to show that this same optimal order of approximation can be achieved even for a 
function with certain singularities when the approximation is constructed by our adaptive 
algoritlim. 

We now specify the singular behavior of f. We assume that 

(20) j (n) < con stj. dist(S,C) a n . 

N 

Here and below, wc take the distance between two sets in F to be the shortest 
distance between them, i.e., 

dist(S,C) := inf |s - c| , 
sfS 
c£ C 
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( 


with |-| denoting Euclidean distance. Our assumption (20) does not imply much about 
distp i n case S n C =* <t > . We make the assumption that 

(21) dist p c* f ' P n' — const f |c| 1/,p (diam C)° for C O S * $ . 

Consequently, 


with 


E,(C) := dist (f,I> ) < const „ E(C) 

f p,C n — f 


E (C) := min{F(C) ,G(C) } 

F(C) := dist(S,C) a_n (diam C) " | C | 1/p 
g(C) := (dist(S.C) + diam C)“|c| 1/p . 

Finally, we assume that the m-dimensional manifold S of singularities of f is smooth 
in the following sense: 

si. It is possible to subdivide D into finitely many (nonoverlapping) pieces 
D so that, for each i, either dist(S,D^) > 0 or else there exists a 

continuously differentiable map <p which maps the cylinder 



z 

m 

:= {x ( )R N : 

0 < x . <1 for 

— l — 

i = 1 , . . . 

2 

,m; 5). x. < 1} 
3 > n> 3 ~ 

one-one onto 

some 

neighborhood 

V. of D. so 

l l 

t hat 




dist (^ . (x) , 
l 

S) = (I x 2 , 1/2 
j>m J 

for all 

*P . (x) f D. . 

l l 

Theorem 

4.i. 

If ft c (n) 

(DNS) and (20) , 

(21) both 

hold for some u 

(22) 



n > a > mn/N - 

(N - m)/p 



and the manifold S of singu) at ities of f is smooth in the sense that it sat isfies 
si above; then the adaptive algorithm, starting from a sub d ivis ion (C" ) for D with 
f (T and E(C|) > c, all i, produces a subdivisi on (0^)^ ojf_ D for which 

K < const f E - 1/(n/N+1/P> . 

Proof . The proof parallels the one for Proposition 3.1. By Theorem 2.2., 

K < $ 1 / dx/0(x,e). To estimate 9(x,e), let x e C e C with P(x,e) = Ic I and 
D xx 

E (C ) = e. By c2, there exists a positive const = const so that 

x N,n 

const diam C >_ |c| > diam C/const, for all C f I . 


i 
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Set 


A := {x f D : dist(S,C ) < diam C } . 

X — X 

Then, for x f A, 

F(C x ) > |diam C x | a |cJ l /P > const |C x |“ /N+1/p 

while, for any x, 

G(C x ) > Idiam c x r|c x | 1/p > const |C x | a/N+1/P . 

Hence , 

e = min{F(C ),G(C )} > const |c |“/ N41// P f or x e A . 

X X — X 

This implies that e N (a+N/p) ^ CO nst C x and so 

dist(x,S) < dist(C ,S) + diam C 

(23) X 1/1 4»/ i 

< 2 diam C < const c 0 P for x f A . 

— x — 

Further, for x f P, 

E < G (C ) < (2 diam C >™|c | 1/P < const |c | a/N+1/ P 

which proves c.iat 

(24) l/0(x,J ) * l/|c x | ^ const t (u+N/p) ^ or x € A . 

By assumption, si holt]?;, hence S has finite ro-d imensional volume. Therefore, (23) and 


(24) combine to cjive 


/ dx/O (x , E ) < const r - N /< a4N / p >| A | 

A 


-N/(a<N/p) (N-m)/(a+N/p) 

< const E constgf 


= const c 


-m/(oHN/p) 


< const c 


-N/ (a+H/p) 


Next, since 


we have 


E < F (C ) < disi(S,C ) n-n (diam C )"|c| 1/P 
— x — X X 

_ ,a-ni i n/N+l/p 

< const dist(S,C x > | C x | 


1/0 ( x , E ) = l/|c I 1 const(dist(S,C )° -n /c ) N/ (niN/p) . 


Now, for x f A , dist(x,S) <^dist(S,C' x > 4 diam C < 2dist(F.,C x > . Thus, 


(25) 


, , -N/ (n+l/p) ... (a-n)/(n/N4l/p) 

1/0(x,e) < e const (dist (x ,S)/2) , x / A 
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1 


It follows that 


t , , , -N/(ntN/p) / , (a-n)/ (n/N+l/p) 

/ dx/0(x,e) <_ c ^ const / dist(x,S) * dx . 

D'-A D 


Finally, we show that the last integral is finite under our assumptions. For this, 


we make use of the smoothness assumption si on S. For each in the postulated sub- 


division of D, we have 


/ dist.(x,S) Y dx <_ |d |dist(D ,S) Y 


D. 

l 


wi th 


y := (a - n)/(n/N + 1/p) 


since y is negative by (22). Hence, / dist(x,S) Y dx is finite in case dist(D^,S) > 0. 


D. 

l 


If, on the other hand, dist(D^,S) = 0, then, by si, 


/ dist(x,S) Y dx = / ( y X 2 ) Y/,2 det •f ' (x) 


dx 


(D.) 
l l 


const / ( y x 2 ) Y ^ 2 dx 

Z j>m J 
m 


= const / |x| Y dx , 
S.. 


N-m 


with the unit sphere in 1R . Since 


1 


/ |x| Y dx = const / / r Y+k ] drds , 

S k 3S k ° 


re have / dist(x,S) Y dx < " provided y > - (N - m) , i.e., provided 

D. 


(26) (a - n)/(n/N 4 1/p) > m - N . 

But this is exactly the second inequality in (22). /// 

Denote by 


n, K 


the collection of piecewise polynomial functions of order n consisting of no more than 


K pieces, with the corresponding subdivision (Ck)* D with r 1 K taken from (t. 


-IB- 


Corollary . Under the assumptions of the theorem , 


dist (f,F ) = 0(K _n/N ) 

p,D n,K 


Proof . For each small enough e, we can find a subdivision (C/)^ for D so that 

E (C.) < E(C.) < E, while K < const c N// * n+N/< P' f or Eom e const = const, „ _ _ 

f i — l — — f ,N,m,n,a ,D,S 

but independent of e. This shows that 

N/ (n+N/p) -1 

(27) e const K 

and implies the existence of an approximation g e IP 


| f — ^ II p 1 Kc ^ i const e 


n,K 
p-N/ (n+N/p) 


for f for wliich 


= const c P"/(" +N /P> < 


const K 


-pn/N 


the last inequality by (27) . /// 

Theorem 4.1 and its Corollary only treat functions with a smooth manifold of 

ci 8 ? 

singularities in the sense of si. Thus, a function like f (x) := x^ + x^ on 1R ' is 
not covered. But, by (13) and its obvious generalization, we clearly get 

dist „(f,P „) = 0(K n ^) for any f which can be written as a finite sum of functions 
p (C n ; K 

satisfying the assumptions of Ttieorem 4.1. Thus, the function f (x) = x” + x^ is 
covered. Still, Theorem 4.1 does not apply to functions like 

f (x) := (XjX^) 01 for x £ 1R 2 . 

Finally, Theorem 4.1 has the assumption that the domain D be representable as the 

finite union of nonoverlapping allowable cells. This is, offhand, a severe restriction. 

E.g., we require all allowable cells to be convex, and, typically, r consists of just 

hyper rectangles . But, if D is not so representable, then it is sufficient to start 

off with some domain D containing D which is the union of nonoverlapping allowable 

cells (C^) provided we can extend f suitably to this larger domain D. The possibility 

of such an extension is already implicit in the discussion of the error function E at 

the beginning of this section. Our estimate (19) for dist (f,F ) makes sense only 

p,C n 

if C C dom f. Without trying to squeeze the most general statement out of our arguments, 
we can say that Theorem 4.1 applies to the approximation of any function f on D which 
can be suitably extended to some bounded convex domain D containing D. The definition 
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Of E, 


offhand defined only for C C p, is then extended to all C t C by 
E(C) := E(C •”> 6), and the condition of Theorem 4.1 is relaxed to require initially 
only a finite covering (CM for p of allowable cells with E(C|) > e, all i. 

Note that, .or m * 0, (26) is stronger than the inequality 

a > (m - N)/p 

needed to conclude that f f I, (0) . One might, for this and other reasons, raise the 
question of whether (26) is necessary. We now show that (26) is necessary in general 
to achieve the optimal approximation rate 0(K n ' /N ) . 

Theor em 4.2. If m > 0, then there exist (C, D, S and f satisfy in g all assump- 
tions of Theorem 4.1 except tha t a is not an integer and satisfies 
(28) - (N - m)/p < a < mn/N - (N - m)/p , 


and, for this f , 

dist (f,P ) * 0(K~ n/N ) . 

P n, K 

Proof . We choose 

N 

S := {x e IK : x^ = 0 for i > m} 

and take 


f (x) := dist (x ,S) 01 . 

N 

We choose D to be the unit cube {x € ]R : 0 < x <1# all i} and take (T to be the 

— l ~ 

collection of all scaled translates of D. 

We claim that 

(29) dist (f,P ) > const I C | a/N+ 1 /P, for aU Cf t, C^S * <t> , 

p,C n — 

for some positive const independent of the particular C. For the proof, let 

N N n 

: K — ► K :xb> px + s for some positive scalar p and some s t s. Then If = P f 

while, for any g e P , cjfi e P . Therefore, if g f P is a best I. -approximation 
n n n p 

to f on C f C, then 

dist (f,P f - / |f(x) - g(x)| P dx 
p,C n ‘ 


= / |p a f(y) - g(py + s)| p p N dy 

■o ' 1 (C) 

> p° P+N dist . (f,P ) 

p.o'V) 
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- 




/ 


But since v* *(x) = p 'x + s' with s’ = -s/p e S, this implies that 

dist (f,F ) = p° N/,p dist , (f,P ) . 

P ' C " PW-’V) 

Associate now with each C ( t a specific map :x' — *■ px + s for which s e S, 

f' 1 (C) ° S 1 * <> and I*" 1 (C) | = 1 . Then P= C 1/N and * _1 (c) n s * 0 . Hence, 
for all C f (C with c n S * 0 , 

dist P .c <f 'V = |c|a/N+ 1 /Pdist p ,,-i (c) (f 'V 

> |c| a/N+1/P const 

with 

const := inf {dist (f ,I> ) : C e I, C n s' 1 * 0 * C O s, I C I = 1 } . 

p.C n 

If now const = 0, then, since dist (f,P ) is a continuous function of C on C 

P.C n 

and the infimum is taken over a compact subset of IT, we would obtain a C £ I with 

| C | = 1 for which f|^ f P^, which is absurd since a is not an integer. 

With (29) thus established, let (CJ^ be an y collection of nonoverlapping cubes 

which cover S n D. Then, by (29) , 

error P : = I dist „ <f,F ) P > const P £ |c.| (pt,/NH1 
. p.C. n — V 1 l' 

l r l l 


while 


i ic.r /N > i 

i 


since they cover S n p. But this implies that. 


error > const i 


> const 6 


inff [ |c.| (Pa/N)+1 : l |c | m/N >lj 

Ui=l i=l 


'll/p 


with 


6 1 :>= inf 


/ K K 'l 

{ l |cJ Y : l |c | =1 

'i=l i=l ■> 


and 


Y := (pa + N)/m . 
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Since y > 1 by the first inequality in (28) , the last infiroum is taken on when 




5. Superconvergence . In this section, we give one more application of Theorem 2.2, 

this time to illustrate how it deals with superconvergence. 

First, consider the step function f on 1R with just one jump, of size 1, say, 

at some point x f (-1,1). The function is to be approximated from P in the 

0 1 / K 

IL^-norm. Clearly, the placement of just one breakpoint, at x^, would provide exact 
approximation. But we are dealing with an adaptive algorithm which only knows (a bound 
for) the function E^, and does not know the point x^. We want to show that, even 
without the exact knowledge of the jump point x Q , our adaptive algorithm performs in 
this case much better than the "optimal" rate 0(K *) would indicate. 


It is easy to see that 


E f (C) := distj c (f,P 1 ) = dist(x Q ,lR^C) 


for any particular interval C. Thus 


0(x,e) = disttx.x^) 4 c 


|E f l t *= / dx/(|x - x Q | + e) = 2 ln(l/c) 4 ln[(l + x Q 4 c ) { 1 - x Q 4 e ) ] . 

Consequently, the adaptive algorithm produces a subdivision with 

K (2 ln(l/c) + const) /8 
intervals for a total error of no more than 

(30) KC < Ke- <BK - COnSt)/2 = 0 (e - BK/2 ) . 

In fact, the total error is <_ e since the approximation fails to be perfect only 
in the one interval which contains x Q in its interior. Further, if interval halving 
is used, i.e., 6 = 1/2, then, at each stage, only the interval containing x^ is sub- 
divided. Assuming x^ to be in general position, i.e., x^ / (r2 S : r,s f 2C } , the 
error with K intervals behaves therefore like 2 K = e K 2 . Thus, the error goes 
to zero even faster than our estimate 0(e in (30) would indicate. 

As a second example, we consider B.^-approximation from P^ K to the function 


f (x ,x > := (x 1 - x ) + . 
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We take D to be the unit square and take for I all scaled translates of D. It is 

now not possible to have f approximated exactly; still, it can be approximated better 

- 1/2 

than the "optimal" order 0(K ) possible for general smooth functions. 

2 

Let C e C. If the line S := {x e R : x^ = x^} intersects C at all, it cuts 
it into a triangle T and another piece, and then E^ (C) = |t|. Otherwise, E^(C) = 0. 


2(h 


E f (C) = 


farthest from S 

and 

h 

is its side, then 

- | x - x I /2) 1 2 

for 

h < 

1 x, - x_ I 

1 1 2 ' + 


— 

1 1 2 ' 

I X 1 ” x 2| 2/2 

for 

h > 

|x i ‘ x 2 ! 


This shows that, for |x 
, 2 


2 2 

x | /2 < e, 0(x,e) = h with h such that 


(h - |x^ - x 2 |/2) = /c/2. Thus, 

9(x,e) = 


(/e/ 2 + |xj^ - x 2 |/2) if |xj - x 2 | >_ /2c 


^ 2e otherwise . 

Consequently, 9(x,e) >_ 2 e for all x, and so l E fl e £ |d|/(2e). But the resulting 
estimate Ke < (const/ (2 e) ) r. = const for the total error is not too encouraging. 

We get a sharper bound as follows. Set 


Then 


< / 2 ./ 2 X , hence 


A := {x e D : |x^ - x 2 | <_ /2c] . 


I dx/9 (x, e) < | A |/ (2C) = 1//T. 

A 


Also, 

/ dx/9 (x, e) = J (/c/2 + | x - x |/2) 2 dx 
D\A 

1 1/2 

<_ 2 / / (/cji + s) 8dsdt < 16//2E . 

0 e/2 

Thus l E fl c £ const //c, hence c <_ const/K 2 for the number K of squares in the 

partition constructed by the adaptive algorithm. The error achieved is therefore no 

-1 - 1/2 
bigger than Kt <_ const/K, or, 0(K ) as compared to the "optimal" rate 0(K ) . 
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6. Algorithm rea li actions for smo oth appro ximatio n. The obvious concrete realiza- 
tion of the adaptive algorithm are for piecewise polynomial approximation such as 
analyzed in Sections 3-5. Most of these realizations would produce discontinuous 
approximations. This is perfectly acceptable for applications such as quadrature, i.e., 
X^-approximation, or in situations where only the accuracy of the approximation matters. 
Other applications require smooth approximations and, in one variable, this may be 
achieved by either using a local approximation scheme that preserves smoothness (see 
Rice [9] for two such methods) or else by "smoothing" the original discontinuous 
approximation by "pulling apart the knots". In principle, one can also "smooth" a 
multivariate piecewise polynomial approximation, but it is not clear that one can do it 
in practice. The simple mechanism of "pulling apart knots" is not available, and the 
problem of carrying out some reasonable local "smoothing" on a piecewise polynomial 
function on a nonuniform subdivision seems insurmountable. 

The difficulty of preserving smoothness with piecewise polynomial approximations is 
illustrated in Figure 1. Near the joint A, the polynomial piece q = q(x,y) for 



Figure 1. A subdivision of the unit square by quadrisection . 

x,y < 1/2 may remain’ fixed while squares above A are continually refined. Unless t 
is exactly equal to q near A, the enforcement of continuity with q at A limits 
the accuracy of the approximations obtained above A. 
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There are four independent properties of an algorithm realization: localness, 
accuracy, smoothness and shape preservation (of the cells) which we desire. The only 

schemes we know which have all these properties are blending f unction sch emes such as 

2 

Coon's patches (see Parnhill (1) for a survey of such schemes in K ) . One may 

interpret "blending function" to mean i ntcrpolat ion to the interior of a cell of data 

N-l 

from ajd of the cell's boundary, i.e., the data functronalr. have values in 1R . Thus, 

only in 1R* does one obtain ordinal y piecewise polynomial approximation, using local 
Hermi te interpolation. 

The analysis of Sections 1 and 2 applies directly to adaptive blending function 
approximations and wc conjecture that these are the only realizations of our adaptive 
algoritlun that produce smooth approximations in for N > 1. 

Our algorithm can be modified to include a constraint on the "generation gap" 
between neighboring cells (recall the terminology of "parent" of a cell introduced in a4) . 
We say that a subdivision is r-gra ded if the difference in generations between neighboring 
cells is at most r. A O-graded subdivision is uniform. One can easily construct- 
situations where this constraint makes the subdivision of one cell the cause for sub- 
division of almost all the remaining cells. In general, a graded algorithm will p>roduce 
a larger K than ot.r algorithm does. We conjecture, however, that this constraint does 
not destroy the optimal rate of convergence obtainfd in Section 4. In fact, it seems 
plausible that (for almost all f) there is an r depending on f, D, E and the 
local approximation scheme, but independent of c, so that all subdivisions produced 
by the algorithm arc r-graded. 

We close by noting that adaptive tensor product algorithms can be devised which 
preserve smoothness for piecewise polynomials, but they cannot achieve the optimal 
convergence rate. 
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